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Sinety students in an introductory chemistry class 
«ere divided into three groups to test the po«er of algorithms to 
increase logical thinking abilities. The experimental group received 
approximately 10 hours of laboratory instruction based on the use i>f 
procedural algorithms. Experiment and control groups «ere tested for 
logical thinking abilities. Preliminary analysis supported the 
contention that the experimental group performed significantly better 
t.han either control group on the posttest measure of logical ability. 
Tie use of algorithms explained a substantial portion of the variance 
in posttest scores. Theoretical as well as educational implications 
are discussed. (Author) 
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BACKGROUND 



In the spring of 1975 the Indiana University Chemistry 
Department approached the Division of Development and 
Special Projects (DDSP) for assistance in developing the 
introductory chemistry laboratory course at Indiana Uni- • 
versity. The authors comprised the interdisciplinary team 
that was formed to develop the course. As a result of our 
preliminary analysis we were able to identify several 
salient learner characteristics: 

(1) The typical student in the course CC121) had little 
or no background in chemistry or the sciences. 
C2) Most students were freshmen or sophomores. 

(3) The course was designed as a terminal level course 
in that students taking this course would not Usually be 
taking any other chemistry laboratory courses. 

(4) Generally speaking, the students were nursing, 
business, liberal arts, or education majors. 

(5) Students were ^extreioely anxious and apprehensive 
about the laboratory environment and their ability to 
perform in the chemistry laboratory. 

In synthesizing all of these characteristics, and paying 
particular attention to the anxiety expressed by the 
students, we chose to use algorithms as an integral part 
of our instructional strategy. As Lewis C1967) notes, an 
algorithm "reduces a problem solving task to series of 
comparatively simple operations, and indicates (for a 
variety of contingencies) the order in which these 
operations should be carried out." We decided that all 
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lab procedures would be expressed in algorithmic form. As 
many have observed algorithms have be^en shown to be very 
successful for dealing with procedures and routines. It 
was felt that the completeness of the algorithm would allay 
much of the anxiety of the ^^tudent. 

During Initial course development and revision, in 
the summer of 1975, it occurred to the team that students 
who used the algorithms might be transferring the inherent 
logic expressed in the algorithms to a problem solving 
strategy, i.e., by using the algorithms the students would 
begin to structure their problem solving strategies in the 
same logical manner as an algorithm. We shall refer to 
this manner of thinking as "logical thinking*" (An 
operational definition of this construct is provided in ^ 
the discussion of the dependent variables, p* 7) » 
Preliminary analysis supported this speculation and as a 
result the developers began an attempt to verify the 
transfer effect found in the use of algorit^hms in 
chemistry laboratory instruction* 



SOME The transfer literature indicates that the use of 

THOUGHTS 

ON algorithms by students on one task could influence per- 
THEORY 

formance on another task. Landa (1974) felt that 

"Although each particular algorithm serves only 
to solve problems of a specific class, in 
devising the algorithms, the students penetrate 
iivto the structure of objects and phenomena of 
the external world and of the intellectual 
processes themselves* They get to know the 
significance of general methods of reasoning, 
they learn how to discover, analyze, synthesize 
and apply the methods**/' (Landa, 165)***Cand) 
-*. there also emerges the ability to apply 
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operations at will to new conditions/ i.e., 
the ability to make broader transfer onto ^ 
these circumstances emerges. Applying the 
operations to new objects or conditions now 
depends ^ess on how much these conditions 
externally resemble those under which 
operations were ^formed* . .such a transfer 
facilitates a' broader and quicker genera- 
^lization of operations (the logic of the 
algorithms) which is extremely important 
for the intellectual development of students. 
The wider the range of transfer^ the greater ^ 
the possibility for new 'moves' of thought, 
for new conclusions and discoveries/' 

Klausmeier and Davis (1969) noted that ".wit is 

thd ability, such as syllogistic reasoning, rather than 

knowledge of the specific content, or syllogisms, that 

facilitates subsequent performance of a broad number 

of tasks***" And again^ to paraphrase Landa: 

"Ve taught them logical operations in the form 
of (laboratory) operations, the logical struc- 
ture of (chemistry) operations In brief, we 
taught them the logic of (chemistry). But since 
the logical structures of chemistry have common 
elements with the logical structures of any 
other knowledge^ when we taught general methods 
of (chemistry procedures) we taught the students 
some general methods of thinking/' (p* 601) 

It was felt that one could encourage the development and 

transfer of "logical thinking,** though one must face the 

problem of measurement of transfer* 

Instructional developers have been sensitive to the 

concerns of content specialists that our measurement 

systems be able to tap higher level abilities. Coupled 

with an interest in assessing "logical thinking," the 

team chose the transfer model as a tool that would enable 

us to measure "logical thinking/' The authors adopted the 

basic experimental paradigm outlined by Klausmeier and 



Davis (19*9) where the transfer group was to perform a 
task (use of algorithms) and then perform a' second task, 
which in this case would be the dependent variable* In 
addition, two control groups performed, respectively, 
parallel chemistry tasks and no tasks at all* It was felt 
that such a separation of treatments isolated the indepen- 
dent variable of algorithmization from a possibly confounding 
variable of familiarization with laboratory procedures and - 
equipment, as well as indicate that learning has taken place* 
Rising from our concern of measuring "logical thinking" 
and the studies which have indicated that the similarity 
between stimulus and response is critical in assessing 
transfer effe^;ts, we chose to use two tests to measure 
"logical thinking*" We selected a similar (the student would 
be given a unique chemistry problem and told to describe a 
procedure to solve the problem) and a dissimilar (an objec- 
tive test that would require minimal Icnowledge of chemistry 
and chemistry procedures) transfer task* Table 1 
suntmarizes this design* 



Dissimilar 

TRANSFER ^ 

Similar 

Chemistry Chemistry No 

and Treatment 
Algorithms 

GROUP 

Table 1 
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PURPOSE 
OF THE 
STUDY 



HYPOTHESES 



The purpose of this study is to determine if using 
algorithms in a chemistry laboratory situation will increase 
a student's skill in "logical thinking." The algorithms were 
used only as procedural guides and were thus an instructional 
strategy, not instructional content. 

The developers suspected that the use of algorithms as 
a procedural strategy in an introductory chemistry course 
would encourage "logical thinking." The following direc- 
tional hypotheses were used to guide the study; 



H, 



H. 



H 
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Students who have had chemistry instruction regardless 
of procedure will perform better on a similar transfer 
task than on a. dissimilar task* 

Students using the algorithms as a procedural guide 
will think in a more logical manner than students who 
have not used the algorithm, \| ^ 
Students who have had chemistry instruction regardless 
of procedural method will think in a more logical 
manner than students ^ho have not had chemistry 
instruction . 



INDEPENDENT 
VARIABLES 



The independent variable will be instructional 
strategy* The variable will have three values; 
Group T The main treatment group in which students 

will receive all procedures are expressed 

through the use of algorithms* 
Group Cj^--A control group in which students will receive 

chemistry instruction and in which all procedures 

are expressed in standard prose format* 



DEPENDENT 
VARIABLES 



Group C2--A control group in which students hiive received 

no instruction in chemistry nor use of algorithms. , 

The dependent variable wilL consist of a score received ' 
on two tasks, analyzed separately. 

S — A transfer task in which studejnts are given a novel 
chemistry laboratory problem and required to solve 
the problem. A score is assigned as a mean score 
based on 4 judges^ estimates of a logical approach 
to solving the problem. 

D — A transfer task in which students are given a test 
that is designed to measure "logical thinking" in a^ 
rion-laboratory situation. A score is assigned based 
on the number of questions answered correctly. 



DESIGN 



INSTRUMENTATION; 

INDEPENDENT 
VARIABLE 



Table 1 summarizes^ the design of the study. We con- 
ducted two studies to test our hypotheses. The design is 
the same for both studies with two exceptions: 1) length 
of treatment and 2} characteristics of C-, . In our first 
study we used students who had taken a similar course^ 
covering the same techn:tques as our, main treatment group. 
For the second, an even tighter control was exercised by 
insuring that exactly the same content was taught, the 
only difference being that the procedures were in 
standard algorithmic form or prose. 

For the independent variable of "algorithms" procedural 
algoritlvns were constructed for the laboratory course* Stu' 
dents were given a lecture of approximately 15 minutes in 
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the use of the algorithm. - Appendix I tHustrates the 
demonstration algorithm.' This algorithm contaijis all the 
attributes found in any given algorithm ^^In the treatment 
group. . - ,^ 

DEPENDENT For the depen4ent variables we j^oristructed two tests. 

VARIABLE - ♦ 

For the similar task the students were given a choice of 

two problems. They would select one problem and pr'opose a . 

technique or m'ethod to ^olve the problem. We selected 4 

chemistry associate instructors for C121 to serve as judges. 

In a^6^^inute training session with the judges we indicated 

that selection of the correct technique, e.g., titration, 

chromatography, was not to be the basis for assigning a 

score. We emphasized that scoring should be based on the 

ability to demonstrate a logical approach to the solution 

of the problem. We outlined guidelines for the judges and 

arbitrarily established a possible range of scores (0-20). 

The judges then grad^ed all tests. The tests were coded and 

shuffled so that the judges would not know whi<;h test 

belonged to which condition. In addition, copies were made 

of each test so that each judge could proceed at his own 

pace and could assign a score without passible cues from 

another judge. 

The mean score for each subject was calculated and 

used for the Analysis of Variance procedures. An intra- 

class correlation was calculated for inter-tater 

reliability and yielded an alpha of .882. 

9 



The use <if^ a similar transfer- task would enable one 

♦ 

<o measure transfer of learning related to the logic of 
chemistry procedural operations aloae. Th^e use af a 
dissimilar transfer task would measure the application 
of "logical thinking" to more general situations. A 
dissimilar transfer task is thus a tesr for general 
ability rather than specific content. 

For the dissimilar task we developed a .test to 
measure "logical thinking." We operationally defined 
this as requiring the following skills: 

1. The student will separate unnecessary" infor-, 
mation from useful information. 

2* The student will determine the next step in a 
Procedure to solve a problem. 

3. The student will orgojiize material, into a 

♦ 

logical order by establishing a mathematical 
relationship , ' 

4, The student wilT make a correct decision after 
a procedure has been followed and observations 
made* " " , 

The test originally^-eonsisted of 35 items. We administered 
the test to a sample of 121 intermediate level chemistry 
students to obtain an estimate of reliability. Using the 
K"R 20 and the Sgearman-Brown correction formula we obtained 
a reliability of .68 with a standard error of measurement 
of 2*12. Eliminating non-discriminating items the test was 
reduced to 24 items* Current use indicates that the revised 
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test has- a corrected, estimate of reliability of approxi- 
mately .80 with a Wtandard erroV of measurement of 1*51* 

At present we can provide ,no validity estimate on this* 
/, tbis testi We believe that we hfave at least achieve a" 
■fair degree of fac^ validity but" will be unable to provide » 
an estimate of construct validity until tthe summer of 1976. ^ 
However, the facr that the meari scored" seem to vary as a 
function of length of instruction lends suppbrt to the 
testes" validity. " 
* " . It is interesting to note ^® found no commercially 

available test of this nature. An examination of several 
test subscales that were similar to our ^operational defini- 
tion of '"logical thinking*' showed that basic algebraic 
problems could be used satisfactorily as admeasure of 
b "logical thinking;** We also believe that knowledge of 

chemistry is not necessary for the test; though it would 

♦ 

be helpful. After the content yalidat ion- has been Com- 
pleted we will make a final item analysis and revision of 
the test. We must emphasize that the test has yet to meet 
an exhaustive validation, but for the moment we think it 
will serve as an adequate measure o6 '-"logical thinking." 

POPULATION For Study I, 600 students enrolled "in an introductory 

chemistry laboratory course at Indiana University -Blooyiington 
and 200 ^students enrolled in an introductory laboratory 
course at Indiana University-P'irdue University at' 
Indianapolis (lUPUI) . The lU-Bloomington students served 
as the Algorithm and Chemistry (T) and No Treatment CC2) 
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groups. The lUPUI students served as the Chemistry only 
group (Cj) • For Study II, 215 students at lU-Bloomington 
served as the population of groups T and Cj^, Stydents 
were randoftily selected for all. groups except Xj* la 
Study I the Cj^ group was "comprised of volunteers, in 
Study II a class section was randomly chosen* 

!^'^Table 2 summarizes the population and sample* The. 
difference's between the number of students selected and 
the number taking the test were due to the students' 
dropping .the course, illness, or otherwise unknbwn causes 

We cannot lay claim to a standardized ^testing pro- 
cedure for all groups* Again, as with any real world 
situation we"" had to adjust to meet the demands of the 
^environment (oh, for a white rati)* InStudy I, students 
in group*T took the tests ia leiu of their normal final, 
e^^am* Students were not informed Of the tests in advance 
but ^er^ assured that their score would not penalize thei 
final. grade* The Cj^ group was paid $3 * 00/student to take 
the test in addition to their regular exam*. All 

students in a group taol^ the test at the same>tiiie. The 

group was al^fewed to take the tests at any one of 
5 sessions before instruction began* 

In Study II, T and students could .take the test 
at any one of 5 sessions* In both Study I and' Study II 
all students were proctored during testing* 'All tests 
and answer sheets were collected after tes^ting* Table 3 
jsiinunairizes the testing prdce tures ^for each group* 



Table 2 



STUD 

- ^ 


Y I 


\ 


STUDY II 


f " ' 

POPULATION: j 

600 s'tudents enrolled iln an int 
chemistry laboratory class at Indian 
University -Blooming ton and ZOO fetude 
enrolled in an introductory laborato 
at Indiana Universityr Purdue Univers 
Indianapolis (lUPUI).' 

SAMPLES: , - 

T 36 students were selected a 

random. 2S students took t 
••test. 

Cj^--ll students were volunteers 
from the lUPUI course. 

i 

C2--36 students selected at rain 
' semester, 1976, at Indiana |) 
before instruction in the c 
data for both studies. ) 


1 

roductory 
nts 

i;y class 
ity at 

i 

I 

from 

iom from the f 
Jhiversity-Blc 
ourse began. 


POPULATION: 

215 students enrolled in an introductory 
chemistry laboratory class at Indiana 
Univers ity •'Bloomingt on. 

SAMPLES: 

T — 30 students were selected at 
random. ' 27 students took the 
test. 

Ci--24 students making up one 

class. ^ The class was randomly 
chosen, not the students . 
20 students took the test. 

)re-registration list for C121, Spring 
^omingtoh. 33 students took the tests 
Data from this group was used as the 




Table 3 



STUDY I 



procedures: 



T — After 30 hrs* of laboratory 

instruction (Fall , 197 S) ktudents 
took the tests in lieu of their 
regular final exams* Assurances 
were made (and accepted) that 
perforntance on the tests would 
not adversely affect thei'r final 
grade* All students were! tested 
at the same time.* 

Cj--After 30 hrs . of laboratory 

instruction (Fall, 197 S) J students 
were advised that we would pay 
volun;teers $3*00 to take the 
tests. All students were tested 
at the same time* I 

i ■ 



Students were allowed to 
in January, 1976., before 
the replication group* 



STUDY II 



PROCEDURES : 



-After 10 hrs. of laboratory 
instruction (February , 1976) 
students were required to take the 
tests* Students were informed that 
failure to do so may jeopardize their 
grade but that the score on the tests 
would not have an adverse effect on 
their final grade* Students could 
take the test at any one of S sessions. 

After 10 hrs. of laboratory 
instruction (February , 1976) 
students were tested as per the 
treatment group. 



take the tests at any one of 5 sessions. Testing took place 
any instruction had taken place, as per the conditions of 



*The tests usually require less than Ik hours to complete 
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RESULTS Appendix II lists the ANOVA source tables for both 

studies. In addition, we performed two other analyses. 
The first test we performed was a Newman-Keul multiple 
range test to determine homogenous groups. We chose 
the Newman-Keul and the level of .10 as this would be 
a less conservative test of the differences. We believe 
that the exploratory nature of this study is such that 
the risk of accepting a false treatment effect is less 
than the possible rejection of a true effect. 

Table 4 lists the means for each treatment group in 
the pilot study (30 hours of instruction) as well as 
associated p values. An indicates homogenous subsets. 



Simi lar 

TRANSFER 

Dissimi lar 


17.8 


8.2 


.5 


13.3 


10. b 


10.9 




Algorithm 
+ 

Chemistry 


Chemistry 
GROUP 


No 

Treatment 




Table 4 







(p<.001) 
(P< .01) 



SIMILAR TRANSFER TASK ^ ■ 

At the end of 30 hours of instruction we found that 
each group in the similar transfer task was signif icaiirTy" 
different. This seems to indicate a transfer of logic 
above and beyond chemistry knowledge;' as well as the 
fundamental concern that ^.earning is taking place. 
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DISSIMILAR TRANSFER TASK 

At the end of 30 hours of instruction we found that, 
the two control groups were not; significantly different. 
Ignoring for the moment the no treatment control we found 
that students did as predicted^' The mean score on the 
dissimilar test for the no treatment control group leads 
us to believe that we may have some validity problems or 
that the task may be so dissimilar that the student's 
general knowledge could be more influential in determining 
the score. , 

Table 5 lists the means, p values, and homogenous 
subsets for Study II. (Note, ^he change of order of the 
cells for the dissimilar task' ) 



SIMILAR 
TASK 



3 .85 



= 3 . 5.7 



.5 



CP < -002) 



Algorithms Chemistry No 

+ ' f Treatment 

Chemistry ! 
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DTSSWIiiAi?- 
TASK 



11.7 


1,^^ 




10.9 


9.8 


■. ' 


Algorithm 
+ 

Chemistry 


■ ^No i 
Treatment 


Chemistry 


GROUP 


Table 


5* ; 



tP^<Tt38D 



*While both Algorithms and Chemistry groups are homo- 
genous with the no treatment group, they are significantly 
different from each ether. 
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SIMILAR TASK ^ 

At the end of 10 hours of instruction we found that 
both trfeatment groups did significantly better than the 
control, though there was no significant difference between 
these two groups. There is a tendency toward transfer of 
"logical thinking" for the main treatment group. We sus- 
pect that this difference would become more pronounced as 
the length of treatment increased. 

DISSIMILAR TASK 



At the end of 10 hours o^ instruction we found that 
the differences were again in the predicted direction. 
With the same caveat we made in Study I concerning the 
no treatment group, we find the differences consistent 
with theory, however modest. 

The second test we performed was a measure of trans- 
fer made between the Algorithm and Ch^istry groups. 
Fdllowing the formula in Murdock (1957) where percentage 
of transfer is the difference between the means of the 
transfer gvoup (T) and the control group (C) to the sum 
of the means we can obtain a rough estimate of the 
"percentage ^f ramfirf er — FtmrHj^^fefrg^u^h- t hft use of algori thms 
controlling for chemistry knowledge. The formula is; 



Table 6 lists the percentage o£ transfer attributable 
to the algprithms for both transfer conditions in both 



percentage of 
transfer 



T-C 



X 100. 



studies . 



17 



16 



Simi lar 



TRANSFER 



Dissimilar 



6.61 


36.9% 


8. SI 


11.31 



10 hr. 30 hr. 
TIME 

Table 6 

HYPOTHESES 

In relation to our initial hypotheses we would make 
the following observations * 

Hj^: Students in the 30 hour group transferred 36.91 
to the similar task compared to 11.3% on -the 
10 hour group, though neither figure was as 
large as those of the first group. 

H2: In all but the:;lb"hour similar transfer task 

students using the algorithms scored significantly 
higher than the non-algorithmic chemistry group. 
The direction of the scores with the 10 hour 
similar transfer group was in the expected 
direction , however- 

H^; In the simila? transfer task we found that students 

3 

with chemistry ^instruction scored higher than the 
no instruction group. The results were mixed on . 
the dissimilar task. 



CONCLUSIONS Murdock*s formula seems to indicate the two major 

conclusions of this study: 
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1* Algorithms appear to make a difference in logical 
thinking abilities* Students appear to transfer 
the logic of a procedural algorithm when solving 
a problem. The true strength of the transfer 
effect still remains undetermined but, as seen in 
Table 6, we may have found an effect. 
Interestingly enough, there was less transfer involved 
with the similar task in the 10 hour group than with the 
dissimilar task. This m^ be due to the effect of the stu- 
dents* general knowledge over and above the main treatment 
effect. The results of the 30 hour group were congruent 
with theoretical expectations. The relatively, large effect 
found in the similar transfer task (36.91) may, in retrospect 
be due to a similarity of the test and recent class exercises 
this could be a confounding variable in our analysis. How- 
ever, the general pattern between the two studies leads one 
to suspect that: 

2. There seems to be a relationship between time in treat- 
ment and transfer. 

" Be^aufse^df~tHe ^ssiBility "of~a "confounding variable^ — 
the nature of the relationships-linear or curvilinear-- 
must remain in determinate. $ 

(NOTE: We have resisted comparing the two 3tudies_ in a 
rigorous statistical manner with time entere<ll in as a 
treatment level because of the differences in the two 
chemistry control samples as well as a lack of rigorous 
sampling procedures. 

19 
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DISCUSSION We think it is perfectly appropriate that this paper 

is being presented in a session entitled "Promoting More 
Effective Learning in Real World Setting^/* indeed the 
authors would be uncomfortable in a session with a more 
formal title* Algorithms were chosen for use in an 
introductory chemistry course as a procedural crutch to 
help anxious students* Self report forms and personal 
interviews showed that this strategy was effective. As 
another possible outcome the authors considered the value 
of algorithms in nurturing some logical approach to solving 
a problem* We suspect that students who use algorithms as 
a procedural guide may transfer the logic of the' procedure 
to new tasks y that as a result they engage in "logical 
thinking." 

The study has its fair share of sampling problems and 
worked with a dependent variable (dissimilar transfer task) 
that is not above reproach* What the study indicates is 
that algorithms may be a powerful tool for the educator, 
that their use as a procedural guide may have a s^rendipi- 
t^us efTec'f~on"hTgliernDrder~thinlcing^rocesses^a 
further research in this field is both warranted and 
possibly fruitful . 
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SOURCE TABLES FOR i STUDY I 



SIMILAR TRANSFER TASK 
ANALYSIS OF VARIANCE 



SOURCE 




SUM OF SQUARES 


MEAN SQUARES 


F RATIO 


F PROS. 


BETWEEN GROUPS 


2 


4SS4.1362 


2277.0681 


213.370 


<.00l 


WITHIN GROUPS 


69 


736.362S 


10.6719 






TOTAL 


71 


S290.4988 









DISSIMILAR TRANSFER TASK 
ANALYSIS OF VARIANCE 



SOURCE 


D.F. 


SUM OF SQUARES 


MEAN SQUARES 


F RATIO 


F PROB. 


BETWEEN GROUPS 


2 


118.8244 


S9.4122 


4.866 


<.010 


WITHIN GROUPS 


77 


940.0631 


12.2086 






TOTAL 


79 


10S8.887S 









ERIC . 



SOURCE TABLES FOR STUDY II 



SOURCE D.F. 

BETI^^ GROUPS 2 

WITHIN GROUPS 74 

TOTAL 76 



SIMILAR TRANSFER TASK 
ANALYSIS OF VARIANCE 
SUH OF SQUARES : MEAN SQUARES 
183.S814 91.7907 
1018. 38S8 13.7620 
1201.9672 



F RATIO 
6.67D 



F PROB. 
<.002 



SOURCE D.F, 

BETWEEN GROUPS ^ 2 

WITHIN GROUPS 77 

TOTAL 79 



DISSIMILAR TRANSFER TASK 
ANALYSIS OF VARIANCE 
SUM OF SQUARES MEAN SQUARES 



44.9420 
8S1.74ks 
896.687S 



22.4710 
11.0616 



F RATIO 
2 . 031 



F PROB. 
<.138 



ERIC , 



